Disfluency in dialogue:an intentional signal from the speaker?

Disfluency is a characteristic feature of spontaneous human speech, commonly seen as a consequence of problems with production. However, the question remains open as to why speakers are disfluent: Is it a mechanical by-product of planning difficulty, or do speakers use disfluency in dialogue to manage listeners' expectations? To address this question, we present two experiments investigating the production of disfluency in monologue and dialogue situations. Dialogue affected the linguistic choices made by participants, who aligned on referring expressions by choosing less frequent names for ambiguous images where those names had previously been mentioned. However, participants were no more disfluent in dialogue than in monologue situations, and the distribution of types of disfluency used remained constant. Our evidence rules out at least a straightforward interpretation of the view that disfluencies are an intentional signal in dialogue. © 2012 Psychonomic Society, Inc

Why Um Helps Auditory Word Recognition: The Temporal Delay Hypothesis

Several studies suggest that speech understanding can sometimes benefit from the presence of filled pauses (uh, um, and the like), and that words following such filled pauses are recognised more quickly. Three experiments examined whether this is because filled pauses serve to delay the onset of upcoming words and these delays facilitate auditory word recognition, or whether the fillers themselves serve to signal upcoming delays in a way which informs listeners' reactions. Participants viewed pairs of images on a computer screen, and followed recorded instructions to press buttons corresponding to either an easy (unmanipulated, with a high-frequency name) or a difficult (visually blurred, low-frequency) image. In all three experiments, participants were faster to respond to easy images. In 50% of trials in each experiment, the name of the image was directly preceded by a delay; in the remaining trials an equivalent delay was included earlier in the instruction. Participants were quicker to respond when a name was directly preceded by a delay, regardless of whether this delay was filled with a spoken um, was silent, or contained an artificial tone. This effect did not interact with the effect of image difficulty, nor did it change over the course of each experiment. Taken together, our consistent finding that delays of any kind help word recognition indicates that natural delays such as fillers need not be seen as ‘signals’ to explain the benefits they have to listeners' ability to recognise and respond to the words which follow them

Speaker- versus listener-oriented disfluency: A re-examination of arguments and assumptions from autism spectrum disorder

We re-evaluate conclusions about disfluency production in high-functioning forms of autism spectrum disorder (HFA). Previous studies examined individuals with HFA to address a theoretical question regarding speaker- and listener-oriented disfluencies. Individuals with HFA tend to be self-centric and have poor pragmatic language skills, and should be less likely to produce listener-oriented disfluency. However, previous studies did not account for individual differences variables that affect disfluency. We show that both matched and unmatched controls produce fewer repairs than individuals with HFA. For silent pauses, there was no difference between matched controls and HFA, but both groups produced more than unmatched controls. These results identify limitations in prior research and shed light on the relationship between autism spectrum disorders and disfluent speech

The influence of conceptual (mis)match on collaborative referring in dialogue

When two dialogue partners need to refer to something, they jointly negotiate which referring expression should be used. If needed, the chosen referring expression is then reused throughout the interaction, which potentially has a direct, positive impact on subsequent communication. The purpose of this study was to determine if the way in which the partners view, or conceptualise, the referent under discussion, affects referring expression negotiation and subsequent communication. A matching task was preceded by an individual task during which participants were required to describe their conceptualisations of abstract tangram pictures. The results revealed that participants found it more difficult to converge on single referring expression during the matching task when they initially held different conceptualisations of the pictures. This had a negative impact on the remainder of the task. These findings are discussed in light of the shared versus mutual knowledge distinction, highlighting how the former directly contributes to the formation of the latter

Is there an Ironic Tone of Voice?

Research on nonverbal vocal cues and verbal irony has often relied on the concept of an ironic tone of voice. Here we provide acoustic analysis and experimental evidence that this notion is oversimplified and misguided. Acoustic analyses of spontaneous ironic speech extracted from talk radio shows, both ambiguous and unambiguous in written form, revealed only a difference in amplitude variability compared to matched nonironic speech from the same sources, and that was only among the most clear-cut items. In a series of experiments, participants rated content-filtered versions of the same ironic and nonironic utterances on a range of affective and linguistic dimensions. Listeners did not rely on any set of vocal cues to identify verbal irony that was separate from other emotional and linguistic judgments. We conclude that there is no particular ironic tone of voice and that listeners interpret verbal irony by combining a variety of cues, including information outside of the linguistic context. © Kingston Press Ltd

Two Techniques for Assessing Virtual Agent Personality

Personality can be assessed with standardized inventory questions with scaled responses such as "How extraverted is this character?" or with open-ended questions assessing first impressions, such as "What personality does this character convey?" Little is known about how the two methods compare to each other, and even less is known about their use in the personality assessment of virtual agents. We tested what personality virtual agents conveyed through gesture alone when the agents were programmed to display introversion versus extraversion (Experiment 1) and high versus low emotional stability (Experiment 2). In Experiment 1, both measures indicated participants perceived the extraverted agent as extraverted, but the open-question technique highlighted the perception of both agents as highly agreeable whereas the inventory indicated that the extraverted agents were also perceived as more open to new experiences. In Experiment 2, participants perceived agents expressing high versus low emotional stability differently depending on assessment style. With inventory questions, the agents differed on both emotional stability and agreeableness. With the open-ended question, participants perceived the high stability agent as extraverted and the low stability agent as disagreeable. Inventory and open-ended questions provide different information about what personality virtual agents convey and both may be useful in agent development